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Abstract  -  This  paper  describes  a  method  for  integrating 
a  frequency-dependent  object  characterization  into  a 
practical  sonar  imaging  system.  Integration  of  joint  time- 
frequency  (JTF)  processing  into  broadband  SAS  imaging 
enables  one  to  add  another  dimension  (frequency)  to  the 
object  feature  space  without  compromising  resolution. 
JTF  processing  enables  a  user  to  construct  a  3-D  image 
description  around  objects  of  interest.  The  Gabor 
transform  is  used  to  capture  the  local  frequency  behavior 
in  the  image.  The  Gabor  coefficients  are  used  to 
reconstruct  multispectral  images. 

I.  INTRODUCTION 

Broadband  sonars  provide  an  added  dimension  of 
information  and  with  that  the  opportunity  to  selectively 
retain  important  object  information  while  eliminating 
geological  features  not  associated  with  the  object. 
Success  relies  on  effective  processing  and  interpretation 
of  the  frequency  information.  Physics  based  object 
models  of  acoustic  backscatter  use  frequency  as  a  prime 
variable,  often  defined  in  terms  of  radius,  a ,  and  acoustic 
wavenumber,  k.  For  example,  fluid  filled  spheres 
insonified  at  low  frequencies  exhibit  sharp  peaks  and 
nulls  in  the  acoustic  backscatter.  [i]  As  ka  increases 
marine  biologists  have  predicted  and  observed  a 
frequency  variation  in  object  strength  associated  with 
shape  in  the  acoustic  return  of  biologies  that  conform  to 
fluid  filled  and  elastic  object  models.  [2] 

The  object  response  to  an  incident  broadband 
waveform  is  the  superposition  of  an  aspect  dependent 
specular  response  and  an  aspect  independent  free 
oscillation  period  [1-4].  The  early-time  response  is 
referred  to  as  the  specular  response  from  the  surface  as 
the  incident  pulse  traverses  the  object.  The  late-time 
response,  or  free  oscillation  period,  is  due  to  energy 
deposited  into  the  object  and  contains  the  natural 
frequencies  of  the  object  [1-4].  Each  natural  frequency 
of  the  object  has  a  characteristic  beampattem  associated 
with  it  and  the  collection  of  frequency  bands  represents 
the  object  response.  Object  characterization  relies  on 
information  from  both  the  broadband  frequency 


independent  scattering  centers  of  the  object  and 
frequency  dependent  information  that  arises  from 
localized  and  dispersive  mechanisms  associated  with 
object  structure  [1-4]. 

Application  of  time-frequency  concepts  to  study  the 
acoustic  response  from  elastic  objects  has  been  well 
documented  [1,2, 5, 6, 7].  Several  papers  have  explored 
the  potential  merits  of  an  expanded  object  description 
and  purported  time-frequency  concepts  to  offer  a  robust 
feature  set  for  object  classification.  Sessarego,  Sageloli, 
Flandrin,  and  Zakharia  [1],  among  others,  have  used 
various  forms  of  the  Wigner  representation  for  a  time- 
frequency  characterization  of  the  acoustical  scattering 
from  a  spherical  shell.  In  their  analysis  they  observed 
velocity  dispersion  of  certain  surface  waves.  Subsequent 
time-scale  analyses  of  the  scattering  from  spherical 
shells  have  produced  similar  observations.  Pinto, 
Belletini,  Hollett  and  Tesei  [7]  observed  the  echo 
response  from  a  partially  buried  spherical  shell  in  the 
spectrogram  of  the  maximum  object  response  of 
beamformed  data. 

In  this  paper  we  merge  a  form  of  JTF  processing 
applied  to  radar  images  by  Chen  and  Ling  [4]  with  a 
SAS  wavenumber  imaging  algorithm  to  develop  a 
frequency  dependent  sonar  image  description  (range, 
cross-range,  frequency)  for  object  characterization. 

Our  processor  is  designed  to  first  create  a  broadband 
image  over  a  large  viewing  area.  When  the  sonar  enters 
an  investigation  mode,  the  user  defines  a  rectangular 
region  of  interest  by  moving  the  mouse  over  the  image 
and  clicking  to  define  a  boxed  area  for  examination  and 
feature  extraction.  This  process  can  alternatively  be 
automated.  Figure  1  below  illustrates  the  broadband 
image  output  and  region  of  selection  for  creating  the 
(x,y,f)  volume  image. 
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Figure  1.  Volume  processing  for  (x,y,f)  image  representation  of 
selected  region. 


Volume  characterization  is  valuable  to  the 
interpretation  of  the  data,  especially  from  buried  objects 
where  geometric  and  shadow  information  is  incomplete 
or  unavailable.  The  following  section  describes  the 
processing  for  (x,y,f)  image  formation. 

II.  V(X,  Y,F)  IMAGE  FORMATION 

The  excitation  signal  is  a  linear  chirp,  c(t),  designed 
to  sweep  across  the  frequency  band  of  interest.  The 
waveform  samples  d(m,n),  along  mTs ,  for  each  ping  n, 
are  related  to  the  object  reflectivity  density,  p(x,y ), 
through  a  sampled  convolution  of  the  form 
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for  sn(t)  =  sn(t)  +  b(t )  and  b(t)  is  bottom  scattering  and 
sn{t)  is  the  impulse  response  function  of  the  object  at 
the  nth  ping.  Inverse  filtering  of  the  data  yields 
sn(t)^sn(t).  [7,8] 

For  d  the  MxN  sampled  data  matrix  in  (1)  and  Hm, 
m=l,2,  ...,M  the  FIR  filter  coefficients  of  the  inverse 
filter  where 
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and  U  and  Q  are  respective  DFT  matrices  of  order 
MxM  and  NxN  then  the  data  transfer  function  matrix  is 
calculated  as 


S  =  HQdUr  (4) 

where  Qlm  =  W^m  and  U ^  for  WL  =  ej^ . 

The  matrix  in  (4)  is  defined  as  the  object  transfer 
function  in  frequency  and  Doppler 

wavenumber, S(co,ku) ,  and  is  related  to  (2)  through  2-D 
Fourier  transform. 

The  type  2  wavenumber  algorithm  [8,10,11]  is  used 
to  form  the  image.  The  wavenumber  algorithm  derives 
from  the  principle  of  stationary  phase  where  the 
relationship  below  forms  the  premise  behind  the 
algorithm 
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co  — >  y  +  ky  ,  ky=ku  is  used  to  map  (4)  into  the 

transform  P(kx,ky)  where  kx  and  ky  are  the  spatial  Doppler 
frequency  variables  in  the  along  track  and  cross-track 


directions.  This  enables  a  2-D  Fourier  transform 
operation  directly  on  P(kx,ky)  to  form  the  image. 

Using  the  relation  in  (5),  the  reflectivity  density 
function,  p(x,y),  is  calculated  from  (4)  as  follows 

p=iQ//EPU-1;  (6) 


where 


P  = 
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and  E  is  a  diagonal  matrix  with  nonzero  elements 

_  jM~  1  l' 

e  J  2  ",  /'  =  0,1,2,...,  M-l. 

The  image  mapping  in  (6)  can  be  interpreted  as  a 
mapping  of  the  object  reflectivity  function.  For  simple 
scattering  image  peaks  correspond  spatially  along  the 
horizontal  range  direction  to  the  scattering  centers  on  the 
object.  Objects  with  complex  scattering  also  exhibit 
image  artifacts  from  localized  components  associated 
with  the  natural  frequencies  of  the  object[4]. 

The  natural  frequencies  of  the  object  associated  with 
the  free  oscillation  period  are  distinguished  by  a  Gabor 
transform  at  each  cross  range  position[4,12].  The 
Gabor  expansion  in  the  horizontal  range  direction  is 

pin,  m )  =  ^  (/?„ ,  gm-k  )hm’k  jm)  (7) 

m',k 


where 


localized  bands.  Figure  2b  is  the  volume  rotated  to  view 
into  the  x-y  image  plane. 
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(i)K',k  O')  =  -  J )  (8) 
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The  inner  products  (prngm'Jc)  f°rm  Gabor 
coefficients  and  can  be  calculated  using  an  FFT  as 

Vnm'k  =Y;Pn  (m)8im  ~  O) 

m 

where  K  is  the  number  of  frequency  channels  and  AM  is 
range  interval  between  samples.  The  coefficients  in  (9) 
describe  at  each  n  the  local  JTF  behavior  around 
(; m'AM,k ). 

The  Gabor  coefficients  were  used  to  plot  the  volume 
image  in  Figure  1.  The  frequency  behavior  can  be  seen 
looking  down  from  the  top  into  the  x-f  plane  of  the 
volume  as  in  Figure  2a.  Here  a  broadband  specular 
scatterer  dominates  the  volume  image  followed  by  some 


Figure  2.  Volume  image  from  the  target  (a)  viewed  into  the  x-f  plane 
(b)  viewed  into  the  x-y  image  plane. 


III.  SUB-BAND  IMAGE  RECONSTRUCTION 

In  creating  the  volume  image  K  >  AM  where 
coefficient  sampling  is  high  and  g(m)  approximates  the 
normalized  Gaussian.  For  this  case  h{k)  ~  cg{k)  [12]. 
This  enables  reconstruction  of  the  image  from  (7)  and 
(8)  making  sub-band  image  reconstruction  possible. 
This  becomes  clear  by  expressing  the  Gabor  coefficients 
in  (9)  as  a  vector  of  K  narrowband  frequency  images  of 
the  form 

\(n,m)  =  \f{)(m,n)  V\(m,n )  ...  V^_\{m,n)Y  (10) 

From  (10)  each  pixel  position  (n,m)  is  described  by  a 
frequency  vector  of  length  K.  Representation  of  the 


volume  is  effectively  a  series  of  narrowband  image 
planes  at  each  frequency  center  k=0,l,  ...K-l.  Sub-band 
image  reconstruction  from  the  Gabor  coefficients 
enables  a  flexible  process  for  narrowband 
characterization  of  the  x-y  image.  Figure  3  illustrates  the 
process. 


Figure  3.  Varying  levels  of  narrowband  image  reconstruction  from 
Gabor  coefficients,  (a)  Large  broadband  swath,  (b)  Broadband  image 
of  selected  object,  (c)  Narrowband  slice  planes  from  Gabor  transform, 
(d)  Image  reconstruction  into  5  frequency  sub-bands,  (e)  Image 
reconstruction  into  3  sub-bands.  ( f)  Image  reconstruction  over  entire 
band. 


IV.  CONCLUDING  REMARKS 


constructed  from  the  Gabor  coefficients  and  enables 
flexible  sub-band  reconstruction  of  the  object. 

The  object  strength  in  any  frequency  band  may  be 
calculated  from  their  respective  Gabor  coefficients.  The 
processor  can  be  interpreted  as  an  adaptive  imager  with 
an  automatic  discrimination  between  localized  and 
broadband  events.  Further  research  includes  weighting 
of  the  Gabor  coefficients  prior  to  image  reconstruction  to 
form  a  composite  image  that  accentuates  localized  object 
features  normally  dominated  by  the  broadband  portions 
in  the  original  image. 
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